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Abstract 

Symmetry plays a fundamental role in design of experiments. In particular, 
symmetries of factorial designs that preserve their statistical properties are 
exploited to find designs with the best statistical properties. By using a 
result proved by Rosenberg [6], the concept of the LP relaxation orthogonal 
array polytope is developed and studied. A complete characterization of 
the permutation symmetry group of this polytope is made. Also, this char¬ 
acterization is verified computationally for many cases. Finally, a proof is 
provided. 
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1. Introduction 

A factorial design D with N runs, k factors, and s > 2 levels is an 
orthogonal array of strength f, where 1 < t < k, (denoted by OA (N, k , s, t.)) 
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if each of the s 4 t- level combinations appear exactly A = N/s l times when 
D is projected onto any t factors. Orthogonal arrays are known to be 
universally optimal for estimating certain statistical models. However, for 
a given N,k,s,t combination finding an OA(N, k,s,t) or proving that it 
does not exist is a notoriously difficult problem. 

Two orthogonal arrays are isomorphic if one can be obtained from the 
other by permuting factors or runs as well as permuting levels in a subset 
of factors. Bulutoglu and Margot [1] enumerated all non-isomorphic or¬ 
thogonal arrays for many N, k , s, t combinations. Their enumeration was 
based on finding all non-isonrorphic, non-negative integer solutions to a 
system of equations with binary coefficients, where each variable represents 
the number of times a factor level combination occurs in the sought after 
orthogonal array and each solution corresponds to an orthogonal array. To 
find all such solutions, they used the integer programming solver with iso¬ 
morphism pruning developed by Margot [3]. They declared two solutions 
to be isomorphic if one could be obtained from the other by applying a per¬ 
mutation belonging to the automorphism group of the constraint matrix. 
In each enumeration in [1], the Margot [3] integer programming solver used 
this automorphism group. 

For a k factor, s level design D, Bulutoglu and Margot [1] defined the 
isomorphism group of D, G s ,k to be the group of all permutations of factors 
as well as permutations of levels of factors in D. G s ,k — S s lSk , where “1” is 
the wreath product and = (s!) fc fc!. Bulutoglu and Margot [1] showed 

that the G s ^k of an OA(Xs t ,k,s,t) is a subgroup of the automorphism 
group G of the constraint matrix defining orthogonal arrays with the same 
parameters. They also observed that G St k = G for each OA{Xs t , k, s, t) 
they enumerated. In this paper, G St k = G unless t = 0 or t = k is shown. 
Furthermore, all the permutation symmetries in the linear programming 
(LP) relaxation of the orthogonal array problem are given. 

The system of equations used in [1] for finding orthogonal arrays had 
also been used by Rosenberg [6] to prove the following lemma. 

Lemma 1. Define a sequence {a c } recursively by 

C — 1 /, _ 

a 0 = A, a c = A-^a e ( _ J (s - l) c_e for c> 1. 

e=0 

Let z, x and y £ {1, • • - ,s} k be row vectors with 0 < d( z,x) < t where 
d( z,x) is the number of non-zero entries in z — x. Also, let / x = {i £ 
{1, • • • , k} : Xi ^ Zi} and J x = {y € {1, • • • ,s} k : y t = Xi Vi £ / x }. Then 
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( 1 ) 


N x = a t _ d(z , x) + (_i)*-«l(«.*)+i £ 

ye J x 

d(z,y)>t 

Ny > 0, for y such that d{ z, y) > t, 

where N x , N y are the number of times factor level combinations x, y appear 
in a conjectured OA(Xs t ,k,s,t). 

In section [2j we use Lemma [T] to define the LP relaxation orthogonal 
array polytope of an OA(As*, k, s, t). We then show that an OA(As 4 , k, s, t) 
exists if and only if its LP relaxation orthogonal array polytope denoted by 
OAP(fc, s, t, A) contains integer vectors where each integer vector represents 
an OA(A s t ,k,s,t). Furthermore, we prove that our formulation defining 
OAP(fc, s, t, A) does not contain any distinct redundant inequalities which 
renders each distinct inequality a facet. 

In sectional the group II(OAP(A;, s, t, A)) consisting of all the permu¬ 
tation symmetries of OAP(/c, s , t, A) is found and completely characterized. 
This characterization is numerically verified for many cases. Finally, this 
characterization and G s ,k = G unless t = k or t = 0 are proven. 


(d(z, y) — d(z, x) - 1\ 

\ t — d( z,x) ) y 


2. The LP relaxation orthogonal array polytope 

The following theorem follows immediately from Lemma [l] by taking 
z = 1 and observing that N x > 0. 

Theorem 1. Let {« c }c=o an d I* be as in Lemma QJ Let 0 < d(l, x) < t 
and 


Ot-d(l,x) + ( — 1) 


t—d( l,x)+l 


E 

ye J x 

d(l,y)>t 


fd(l.y) - d(l.x) - 1A 

( V-d( 1,X) 


Ny > 0, 


( 2 ) 


where J x = {y G {1, - • - ,s} fc : yi = Xi Vi £ / x }- Then an OA(As 4 , fc, s, t) 
exists if and only if there exist integers N y satisfying the inequalities (0). 

Theorem [1] converts the Bulutoglu and Margot [1] integer linear pro¬ 
gramming (ILP) problem with equalities to an ILP problem with inequal¬ 
ities only. This is done by deleting the set of basic variables N x with 
d(x, 1) < t after implementing Gaussian elimination. Deletion of these 
variables is only possible because the coefficients of all N x are 1 and the 
coefficients of N y with d(y, 1) > t are all integers at the end of Gaussian 
elimination. The substance of Lemma [T| in [6] is that it correctly identi¬ 
fies which set of basic variables is an integer combination of the remaining 
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variables. This enables us to delete these variables from the Bulutoglu and 
Margot [1] ILP. In Section [3J it is shown that the size of the symmetry 
group that can be exploited by the solver in [3] is k!((s — l)!) fe if variables 
are deleted and k\(s\) k otherwise. A speed comparison of these two formula¬ 
tions under Margot [3] solver where their corresponding symmetry groups 
were exploited is made in Table 1. For each OA(iV, k,s,t) enumerated, 
the second and third columns of Table 1 report the number of enumerated 
OA (N, k, s, t) by exploiting the groups of size &!(s!) fc and k\((s — l)!) fe before 
and after deleting variables respectively. Likewise, fourth and fifth columns 
report solution times before and after variables are deleted. Even though 
the new formulation has fewer variables, computational experiments sum¬ 
marized in Table 1 suggest that it should not be preferred over the original 
formulation. It is evident from Table 1 that exploiting the larger symmetry 
group more than overcomes the additional computational burden of having 
a larger number of variables. In fact, the computational savings appear to 
grow exponentially with the number of variables. On the other hand, the 
cases OA(64, 7, 2,4) and OA(24,11, 2, 3) do buck this trend. 

For a general ILP with only equality constraints over non-negative in¬ 
teger vectors, deleting variables by using Gaussian elimination may not 
always be possible either because there is no set of basic variables that are 
integer combinations of the remaining variables plus some integer or it may 
be very difficult to identify such a set of basic variables. For example, for 
the ILP in [1] when k = 8, s = 2, and t = 3, we estimated the proportion 
of such sets of basic variables to all sets of basic variables to be .5%. This 
estimate was calculated by repeating the following procedure 1000 times. 
First randomly permute the columns of the constraint matrix, augment the 
resulting matrix with its right hand side, then row reduce it to its reduced 
row echelon form and record if the output has only integer entries. 

Let to = £i=(t+i) Cl)(s — 1 y. The following definition arises naturally 
from Theorem [l] 

Definition 1. The set of N y £ R m with k > d( l,y) > t + 1 that sat¬ 
isfy the system of inequalities (d|j is called the LP relaxation polytope of 
OA(Xs t ,k,s,t) denoted by OAP(k, s,t, A). 

Note that OAP(fc,s,t, A) is a polytope not an unbounded polyhedron 
because it can be embedded inside the hypercube [0, A] m . 

Theorem 2. The OAP(k, s,t, A) is full dimensional for all A. 

Proof. Let TO be as above and l m be the to x 1 vector of all Is. We 
prove this result by showing that \/s k ~ t l m is an interior point of the 
OAP(fc, s, t, A). Rosenberg [6] showed that the system of equations in 
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Lemma Q] is equivalent to 


N x = A for all f-subsets I of [k] and all a 6 [s] fe , (3) 

x€[s]^ 
xi =aj Vi£7 


where [s] k = {1, • • • , s} fc and [k] = {1, • • • , k}. It is clear that A /s k t l s k 
solves the system of equations ([3]) in (R + ) s . Then N x = X/s k ~ t and 
Ay = A/s fc_t for d(x, 1) < t and d( y, 1) > t respectively solves the Lemma 
[□system of constraints 0. Now, clearly X/s k ~ t l m satisfies all the inequal¬ 
ities defining the OAP(fc, s,t, A) strictly. Hence it is an interior point. 

Next, we prove that none of the constraints in Theorem |T| is redundant 
unless k = t + 1 and s = 2. 

Theorem 3. Each one of the distinct s k inequalities in Theorem\7\ defining 
the OAP(k , s, t, A) is a facet and no facet is repeated unless k — t + 1 and 
s = 2. 


PROOF. At least one of the inequalities in (0 is a facet since otherwise 
OAP(/c, s, t, A) would be an unbounded polyhedron. Then there exists N y £ 
R m satisfying all but the facet defining inequality in 0. Let < 0, 

< (uo) £ t be the left hand side in constraints 0 corresponding to the 
facet defining inequality in 0, where 


/(u) 


x if d(u, 1) < f, 
y otherwise. 


Hence there exist vectors N y G R m and N* G K s m that satisfy the 
equations in constraints 0 such that AI y > 0 and N* > 0 for x ^ Uo and 

y/u 0 , where A^uq U °^ < 0 . The group G Sj fc = S s l Sk sends vectors in 
that satisfy the equations in constraints 0 to vectors that satisfy the same 
equations. Furthermore G Sj fc acts transitively on the variables of constraints 
0- Hence for each Uo G [s] fc , there exists a solution with Nuj^ 10 ' 1 < 0 and 
AIw > 0 for w / u 0 , w G [s] k . Then there exists N y G K m satisfying all 
but one facet defining inequality in 0 whose left hand side is A r uo UO ' ) < 0 
in constraints 0 for arbitrary Uo G [s] fc . Hence there are no distinct 
redundant inequalities in 0 and each distinct inequality is a facet. 

Observe that unless k = t+l and s = 2, {y 6 J Xl : d( 1, y) > (} / {y G 
J X2 : d(l,y) > t} whenever Xi / x 2 . Hence no facet is repeated unless 
k = t + 1 and s = 2. For the degenerate case k = t + 1 and s = 2, there is 
only one variable Nf 2 2 ... and we get N^ 2 2 2 ) — ^ anc ^ ~^(2 2 ■■■ 2 ) — ~^ 

each repeated 2 fc_1 times. 
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Remark 1. While it is true that S s l Sk acts as a group of symmetries on 
OAP(fc, s, t, A), this action is no longer as a group of linear transformations 
(as is the case for the full system of equations (j3j) ), but rather as a group of 
affine transformations. In particular S s l Sk does not permute the variables 
of OAP(fc, s, t, A), but rather, it acts by permuting the half-spaces defined 
by inequalities (0. Furthermore, this action is transitive. 

We verified Theorem [3] when A = 1 for each ofs = 2,4<fc<13, 
2 < t < k — 2, s = 3, 3 < fc < 8, 2<£<fc — 1, and s = 4, 3 < k < 6, 
2 < t < k — 1 cases. Our verification was based on finding interior points 
on each facet of the OAP(fc, s, t, A) as follows: Let Bx < d be the system of 
inequalities in Theorem |T] defining the OAP(fc, s, t , A). Let B'x < d' be the 
same system after the Pth inequality is deleted. Also, let (b i) T be the Pth 
row of B and Ft be the hyperplane defined by the equality (b.j) T x = cp. To 
find interior points on (~l OAP(fc, s, t, A), each face of the OAP(fc, s, t, A), 
find feasible solutions to the following linear program 


min 1 T 
such that (b l ) 
B ' x < d 4 - 


x 

T x = di 


1000 


1 . 


3. Permutation symmetries of the LP relaxation orthogonal array 
polytope 

We first define the permutation symmetries of a polytope. 

Definition 2. Let P be a full dimensional polytope in R m . A permutation 
of coordinates of R m that also sends P onto itself is called a permutation 
symmetry of P. The set of all such transformations forms a group called 
the permutation symmetry group (II(P)) of P. 

The variables N y in Theorem [1] are indexed by all factor level combi¬ 
nations y £ [s] k with d(y, 1) > t and II(OAP(fc, s, t, A)) permutes those 
variables. The following theorem explicitly describes a nontrivial subgroup 
of II(OAP(/c, s,t, A)). 

Theorem 4. Let 

ift = 0, 

Hk,s,t — < S (s _d l Sk if0<t<k and (k > t + 1 or s > 2), 

[ I otherwise, 

and I be the identity group. Also, let Y = { y £ [s] fc : d{ y, 1) > t}. 
Then, when Flk,s,t is not defined to be I , it naturally embeds as the group 
of permutations that preserve Y , and Hk, s ,t C H(OAP(k, s, t, A)). 
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PROOF. It is easy to see that each element of Hk s t maps Definition|T]defin- 
ing constraints of the OAP(fc, s, t, A) to each other. Then, v £ OAP(fc, s, t. A) 
=>■ h(v) £ OAP(fc, s, t. A) for all h £ Hk, s ,t- Hence Hk, s ,t maps the OAP(k , s, 
t , A) into itself. On the other hand, for a given v £ OAP(/c, s, t, A), we have 
/i(h -1 (v)) = v as ft _1 (v) £ OAP(fc, s, t , A). This implies that h(OAP(k , s, t, 
A)) = OAP(fc, s,t, A) for each h. Hence Hk, s ,t C n(OAP(fc, s, t, A)). 

Remark 2. For k = t + 1 and s = 2 there is only one variable N y with 
d( y, 1) > t, hence n(OAP(fc, s, t, A)) = I. For the case t = 0, there is one 
constraint on the s k — 1 variables. The coefficients of this constraint are all 
— Is, hence H^ s o — S s k -i ■ If t = k there are no variables in inequalities 

(Ell- 

Next, we develop tools for calculating n(OAP(fc, s, t, A)). As noted in 
[4], the set of all permutations of coordinates in M m mapping P onto it¬ 
self consists of all permutations of coordinates that map facets of P onto 
its facets. Hence, if all the facets of an OAP(fc, s,t, A) are known then 
n(OAP(/c, s, t, A)) can be calculated explicitly. We calculated 11(0AP(k, s, t, 
A)) explicitly for all the k,s,t combinations in which Theorem [3] was veri¬ 
fied. This was done by first calculating 

Gk, s ,t = {tt| there exist a s.t. A fcjSit (7r, a) = A fc:M } 

where A.k.s,t is the constraint matrix of inequalities (J2J) in Theorem |T| and 
Afc, S) t(7T, a) is the resulting matrix when the rows of A k, s ,t are permuted ac¬ 
cording to a and columns according to n. Then Hk jS ,t < n(OAP(fc, s, t, A)) < 
Gk, s ,t as n(OAP(fc,s,f,A)) must preserve the constraint matrix. We chose 
calculating Gk, s ,t over directly calculating n(OAP(fc, s, t, A)) for the sake of 
convenience. Finding Gk tS ,t only, proved to be sufficient in all the cases we 
considered. Gk lS ,t was calculated as described in [4], by first mapping the 
matrix 

0 A-k, a ,t 

. A L , t o 

to an edge colored graph and then finding its automorphism group. Nauty 
software [5] was used to calculate the automorphism groups. In all the fc, s, t 
cases studied, it was found that |Gfc, s ,t| = ((s — l)!) fe fc! = \Hk }S ,t\ implying 
Hk,s,t = n(OAP(£;, s, t, A)). We will prove this observation after proving 
two lemmas. 

Lemma 2. Let GG be the group of maps 4> from [s] fc to [s] fc that preserve 
the Hamming distance, i.e. d(x, y) = d(</>(x), for all <f> £ GG. Then 
GG = S s lSk ■ Furthermore, ifG± is the subgroup of GG such that r(l) = 1 
for all t in G± then G\ = 5( s _i) l Sk- 

Proof. Replace F g with Z s , the ring of integers mod s and F* with Z s —{0} 
in Theorem 5 and Theorem 6 as well as in their proofs in [2]. Also, replace 
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the term “vector space” with “Z™”. Then the resulting theorems and their 
proofs are still valid as the proofs never use the multiplicative invertibility 
of non-zero elements. Now, replace {0,1, • • • , s — 1} with {!,••• , s} to get 


GG = S {1> ..., 8} lS k 9iS B lS k 


and 


G i = S {2> ... , s } l Sk = 'S'(s-i) l Sk- 


Lemma 3. If k — t > 2 then the elements of {a c }*_ 0 in Theorem\ 7] are all 
non-zero and distinct. 


Proof. {a c }‘_ 0 in Lemma |T] are the same {a c }‘_ 0 in Theorem m Ax = 
A I s k ~ l and N y = A/s fc_t solves the Lemma |T] system of constraints. Plug¬ 
ging in TVx = A /s k ~ t , N y = A/s fe_t and multiplying both sides of equations 
in m by s k t /X we get 


r>k — t 


~® J t—d{ z,x) 1 ( 1) 


_-| \t—d( z,x) 


ye J x 

d(z,y)>t 


d(z,y) - d( z,x) - 1 
i — d( z, x) 


(4) 


Taking z = 1 and x = (2(1,.) T , (1 k-r) T ) equation 0 implies that 






There are k — t > 2 positive integers inside the summation in equation (0) . 
This implies that a c ^ 0 for 0 < c < t, and a c a c +i < 0 =>■ a c ^ a c +i for 
0 < c < t — 1. Furthermore, if at~ ri = at-r 2 for some 1 < r^ < r\ < f then 
we must have ri = r% (mod 2). This further implies that 


k — t 

Z>- i)(‘- r i+o 


( * 
\t + 



\(*-r 2 +®) 




t + i - r 2 - 1\ 
t - r 2 / 


for some 0 < r 2 < r± < t. However, this is impossible as 


0 < (s - l)f* r l+*) 



1) 


(i-r 2 +i)( k — r 2 Wt + 
Vt + < - r 2 t V 


■ r 2 - 
t - r 2 ' 


Hence at- ri ^ a.t-r 2 and < |at-r 2 | for all 1 < r 2 < r± < t. Finally, 

each a c is divisible by A = ag by the nature of the difference equation 
defining a c , and |a c | is strictly increasing with c as c goes from 1 to f. 
Hence a c ^ ao = A for c ^ 0. 


Equation (0 provides a closed form formula for the solution of the ao = A 
special case of the inhomogeneous recurrence relation of degree k — t + 
1 in Lemma [f] This recurrence relation is equivalent to a homogeneous 




recurrence relation of degree k — t + 2. Solving such an equation requires 
finding all complex roots of a degree k — t + 2 polynomial. Coming up with 
this closed form formula for arbitrary values of k — t without relating a c to 
the orthogonal array problem appears to be difficult. 

Theorem 5. H(OAP(k 1 s, t, A)) = Hk, s ,t- 

PROOF. By Remark [2] it suffices to consider the case 1 < t < k — 1 and 
(k > t + 1 or s > 2). 

Let B >t ( 1) := {y G [s] k : d(l,y) > t}, B< t { 1) := {x G [s] k : d( l,x) < 
t}, and B t ( 1) := {x G [s] fc : d( 1, x) = t}. Let a G II(OAP(fc, s, t , A)), i.e. a 
is a permutation of B >t ( 1) which permutes the inequalities 0 of Theorem 
[Qby acting on the variables: N y H > N a ^ y p Extend a to a permutation of 
all [s] fe by assigning <r(x) = x for x G B< t { 1), where a sends the inequality 
corresponding to x to the inequality corresponding to x. By the distinctness 
of the elements of {a c }*_ 0 , where c = t — d(l,x), we have 

d(l, x) = d(l, cr(x)) Vx G B< t (l). (6) 

For these x we also have 

ff(J*)nB >t (i) = J CT(x) nflx(i). (7) 

By © , a must map the inequality corresponding to x = 1 to itself. Thus 
cr preserves the coefficients of N y for {y : d(l,y) > t}. 

Then we must have 


d(l, y) = d( 1 , cr(y)) Vy G B >t ( 1 ). 

For x G -Bi(l), with Xi = a 1, write ui(i,a ) = (j,b) where cr(x)j = 
i) / 1. If u}(i,a ) = (j, b) and ui(i,d) = ( j,b ) with i i (sharing the first 
component j). then consider an element y G B >t ( 1) such that yt = a and 
yi = a; by equation © above we have cr(y )j = b = b, and w is not injective, 
contradicting the injectivity of a. Hence, i = i and this implies a = a. It 
follows that in the equation uj(i,a) = (j, b), j only depends on i and not on 
a. 

Finally, for an arbitrary y G B >t ( 1), a( y) is determined by the function 
w, since by equation 0 we have cr(y)j = b , where i/, = a / 1 and ui(i, a ) = 
(j, b); this determines cr(y) uniquely, as we know that d(a(y), 1) = d( y, 1) 
and j j whenever i ^ i. Thus a is a permutation of columns and of 
non-one elements in each column, that is, a is an element of S s -\ l Sk- 

Theorem 6. Unless t = 0 or t = k, G Sj fc = S B l Sk in Theorem 9 of 
Bulutoglu and Margot [1] is the largest subgroup of S s k that sends equations 
0) to themselves. For t = 0 or t = k the largest such group is S s k. 
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PROOF. First, consider the case when 0 < k~t < k. Let G be the group of 
all coordinate permutations of [s] fe which permute the rows of the constraint 
matrix A pertaining to equations JH) in the full space R s . It was shown 
in Bulutoglu and Margot [1] that G contains G Si fc as a subgroup. Hence, it 
suffices to show that G < G St k- First, we show that every element in G is 
an isometry. 

Let a G G and z G [s] fc . Since G St k acts transitively on [s] fc and itself 
consists of isometries, we may assume cr(z) = z. Consider the set S of all 
rows of A in which z appears. Since er(z) = z, a must permute S. Let 
w G [s] fe be such that d( z,w) = i, where i G {0,1, • • • , k — t}. Then w 
appears in exactly ( fe 7 l ) rows in S. Since a preserves S, cr(w) also appears 
in exactly ( k ^ 1 ) rows in S. Then we must have d( z, cr(w)) =ias no element 
is repeated in the set {(7*)}*=o- Hence d( z,w) = d(cr(z), er(w)) for all z 
and w such that 0 < d( z, w) < k — t. 

Now, for any z and y such that d( z, y) = k — t + 1 there exists yi such 
that d( z,y) = d(z,yi) + d(yi,y), where d(z,yi) = k-t and d( yi,y) = 
1 < k — t. By the triangle inequality d(a(z), cr(y)) < d(a(z), cr(yi)) + 
d(fj(yi), cr(y)) = k — t + 1 = d( z, y). By repeating the same argument for 
z and y such that d( z, y) = k — t + i for i = 2, • • • , t we get 

d(a(z),cr(y)) < d(z,y) (8) 

for all z,y and a. Let zl = <r(z), y' = cr(y) and h = ct” 1 then 

d(z',y') < d(h(z'),h{y')) (9) 

for all z',y' and h. Combining inequalities © and © we get 

d(cr(z),cr(y)) = d{ z,y) 

for all z, y G [s] fc and a G G. Hence, by Lemma [21 an isomorphic copy of 
G is contained in S s l Sk■ Now, this implies that G < G s ,k — S s l Sk■ The 
cases t = 0 and t = k are easy to see. 
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Table 1: Formulation Comparisons 


OA (N, k, s, t ) 

Bulutoglu and 
Margot [2] 
Number of 

OA (N, k, s, t )s 

After Deleting 
Variables 
Number of 

OA (N, k, s, t )s 

Bulutoglu and 
Margot [2] 
Formulation 
Times (sec.) 

After Deleting 
Variables 
Formulation 
Times (sec.) 

OA(20,6,2,2) 

75 

3069 

1.42 

63.99 

OA(20,7,2,2) 

474 

51695 

13.4 

2578.82 

OA(20,8,2,2) 

1603 

383729 

108.96 

66377 

OA(20,9,2,2) 

2477 

1157955 

484.55 

879382 

OA(20,10,2,2) 

2389 

> 28195 

1683.95 

> 37214 

OA(24,5,2,2) 

63 

723 

1.07 

18.36 

OA(24,6,2,2) 

1350 

62043 

22.03 

1381.39 

OA(24,7,2,2) 

57389 

6894001 

1720.96 

428220 

OA(24,8,2,2) 

1470157 

4505018 

99738 

653671 

OA(24,9,2,2) 

3815882 


763643 

- 

OA(24,5,2,3) 

1 

2 

0.13 

11.64 

OA(24,6,2,3) 

2 

5 

0.25 

11.67 

OA(24,7,2,3) 

1 

5 

0.32 

16.04 

OA(24,8,2,3) 

1 

6 

1 

22.88 

OA(24,9,2,3) 

1 

6 

5.9 

44.02 

OA(24,10,2,3) 

1 

5 

55.49 

128.95 

OA(24,ll,2,3) 

1 

3 

519.62 

460.59 

OA(32,6,2,3) 

10 

31 

1.85 

12.2 

OA(32,7,2,3) 

17 

76 

1.82 

16.13 

OA(32,8,2,3) 

33 

194 

6.59 

77.49 

OA(32,9,2,3) 

34 

364 

23.75 

658.38 

OA(32,10,2,3) 

32 

561 

102.39 

7338 

OA(32,ll,2,3) 

22 

> 441 

560.29 

> 36463 

OA(40,6,2,3) 

9 

65 

0.52 

12.92 

OA(40,7,2,3) 

25 

580 

2.01 

40.68 

OA(40,8,2,3) 

105 

6943 

19.71 

4178 

OA(40,9,2,3) 

213 

43713 

206.25 

260919 

OA(40,10,2,3) 

353 

> 1511 

1764.73 

> 36279 

OA(48,6,2,3) 

45 

355 

2.01 

18.27 

OA(48,7,2,3) 

397 

13469 

33.73 

862.1 

OA(48,8,2,3) 

8383 

896963 

2231.77 

552154 

OA(54,5,3,3) 

4 

49 

1.9 

36.01 

OA(54,6,3,3) 

0 

0 

17.14 

167.07 

OA(56,6,2,3) 

86 

1393 

4.44 

36.02 

OA(56,7,2,3) 

4049 

285184 

443.4 

20415 

OA(64,7,2,4) 

7 

21 

98.83 

15.45 

OA(64,8,2,4) 

3 

10 

12.17 

23.39 

OA(80,6,2,4) 

1 

6 

0.52 

11.86 

OA(80,7,2,4) 

0 

0 

0.37 

15.01 

OA(81,5,3,4) 

1 

2 

15.75 

19.56 

OA(96,7,2,4) 

4 

31 

3.14 

15.41 

OA(96,8,2,4) 

0 

0 

2.28 

60.39 

OA(112,6,2,4) 

3 

25 

1.24 

12.7 

OA(112,7,2,4) 

0 

0 

1.24 

17.36 

OA(144,8,2,4) 

20 

3392 

1792.82 

1535314 

OA(162,6,3,4) 

0 

0 

19.8 

266.8 
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